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Abstract: Background: Observational pharmacoepidemiological (PE) studies on drug safety have produced discrepant 
results that may be due to differences in design, conduct and analysis. 

Purpose: The pharmacoepidemiology work-package (WP2) of the Pharmacoepidemiological Research on Outcomes of 
Therapeutics by a European ConsorTium (PROTECT) project aims at developing, testing and disseminating 
methodological standards for design, conduct and analysis of pharmacoepidemiological studies applicable to different 
safety issues using different databases across European countries. This article describes the selection of the safety issues 
and the description of the databases to be systematically studied. 

Methods: Based on two consensus meetings and a literature search, we selected five drug-adverse event (AE) pairs to be 
evaluated in different databases. This selection was done according to pre-defined criteria such as regulatory and public 
health impact, and the potential to investigate a broad range of methodological issues. 

Results: The selected drug-AE pairs are: 1) inhaled long-acting beta-2 agonists and acute myocardial infarction; 2) 
antimicrobials and acute liver injury; 3) antidepressants and/or benzodiazepines and hip fracture; 4) anticonvulsants and 
suicide/suicide attempts; and 5) calcium channel blockers and malignancies. Six European databases, that will be used to 
evaluate the drug-AE pairs retrospectively, are also described. 

Conclusion: The selected drug-AE pairs will be evaluated in PE studies using common protocols. Based on consistencies 
and discrepancies of these studies, a framework for guiding methodological choices will be developed. This will increase 
the usefulness and reliability of PE studies for benefit-risk assessment and decision-making. 
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calcium channel blockers, drug toxicity, european medicines agency, fractures, liver injury, myocardial infarction, neoplasms, 
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Bridging Differences in Outcomes of Pharmacoepidemiological Studies 

INTRODUCTION 

Randomised Clinical Trials (RCT) of drug adverse events 
do not optimally reflect real life situations: small sample 
sizes, highly selected populations and short duration of 
exposures [1]. During the past decades, it has been realized 
that adverse drug-events (AE) need to be further evaluated in 
pharmacoepidemiological (PE) studies [2]. PE methods 
were, however, still in development and therefore had the 
potential for reporting biased results. An example is the 
falsely reported relationship of breast cancer to use of the 
blood pressure lowering drug reserpine [3]. The growing 
availability of large routine electronic health record 
databases has made it possible to study less frequent and less 
severe AEs. An example is the risk of deep venous 
thrombosis in users of third generation oral contraceptives 
[4]. Alhough (pharmaco)-epidemio logical methods have 
progressed, the challenge of studies of low absolute and 
relative risks associated with medications may have pushed 
pharmacoepidemiology to the borders of what can reliably 
be detected beyond the level of background noise [5]. 
Furthermore, efforts focusing on evaluation of type A AEs 
(those with dose dependent and predictably augmented 
pharmacological effects) and intended effects of drugs have 
increased the potential for bias [6]. 

Study conduct and design choices are one of the factors 
contributing to the diversity and discrepancy of study results. 
For instance, using the same database (the UK Clinical 
Practice Research Datalink [7] and including a large number 
of patients, two studies that were independently conducted 
reached very different conclusions [8, 9]. Within the same 
source study population, discrepant results between studies 
can be explained by small differences in study design such as 
different definitions of exposure time windows, confounder 
selection and age matching [9, 10]. Moreover, exposure- 
time-dependent hazard functions can substantially affect 
comparisons between different studies of the same drug [11]. 
The use of different statistical methods to adjust for 
confounding is another explanation for dissimilar study 
results [12]. For instance, in a database study and in 
simulation studies, systematic differences were found in 
effect estimates when propensity scores were used compared 
to logistic regression or Cox-proportional hazards regression 
[13, 14]. Immortal time bias has been suggested as another 
important source of variability in results between 
observational studies on drug effects [15]. Furthermore, 
several studies that have evaluated the same data source have 
drawn different conclusions about the plausibility of a 
pharmacological explanation of an observed association. 
Among these are: use of inhaled corticosteroids and risk of 
hip fracture [16, 17], use of beta-blocker and risk of hip 
fracture [18, 19]; use of oral bisphosphonates and risk of 
cancer of oesophagus [20, 21]; and more recently, use of 
proton pump inhibitors and risk of hip fracture [22-25]. 

The influence of methodological variation should be 
minimized and quantified, in order to interpret differences in 
associations between drugs and AEs that arise between types 
of data sources and healthcare systems in the different 
countries. A clear interpretation of differences in results 
between studies performed in the same database, and 
between different databases, is currently not completely 
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feasible due to these methodological differences. This 
situation poses difficulties for all stakeholders, such as 
regulatory agencies, industry, healthcare professionals and 
patients. Difficulties in interpreting individual and/or groups 
of observational studies limit their usefulness for decision 
making on the benefit-risk balance of drugs. These 
experiences highlight the need to increase understanding of 
the implications of different methodological choices by 
investigators and for a framework on PE methodology across 
different data sources. To understand and subsequently 
validate differences caused by methodological and non- 
methodological (data related) factors we have selected five 
different drug-AE pairs, to be analysed in five different 
European databases based on a common protocol that 
includes extensive sensitivity analyses. 

The Pharmacoepidemiological Research on Outcomes of 
Therapeutics by a European ConsorTium (PROTECT) study 
is a collaborative European project that addresses limitations 
of current methods in the field of pharmacoepidemiology 
and pharmaco vigilance [26]. PROTECT is a multinational 
consortium of 29 partners including academics, regulators, 
small and medium enterprises (SMEs) and European 
Federation of Pharmaceuticals Industries and Associations 
(EFPIA) companies, coordinated by the European Medicines 
Agency (EMA) with GlaxoSmithKline (GSK) as deputy co- 
ordinator. The "Framework for pharmacoepidemiology 
studies" work-package (WP2) of PROTECT, co-led by 
Utrecht University and Pfizer, aims at developing, testing 
and disseminating methodological standards for the design, 
conduct, and analysis of PE studies applicable to different 
safety issues using different data sources. This article 
presents the rationale, design and the first results of the WP2 
of PROTECT initiative. 

METHODS 

Selection of Drug-AE Pairs 

Criteria for the selection of key AEs to evaluate in 
different databases included: 1) the AE selected having 
resulted in (major) regulatory decisions such as drug 
withdrawal or major summary of product characteristics 
(SmPC) changes; 2) public health impact aspects including 
seriousness of the event (prioritise more serious events); 
having variable incidence rates (both rare and common 
events); and prevalence of drug exposure (commonly used 
drugs and infrequently used drugs); 3) possibility to 
investigate a broad range of relevant methodological issues 
including feasibility to ascertain events in electronic 
healthcare databases (events both easy and difficult to 
ascertain); hazard functions (acute and long-term effects, 
delayed/transient effects); setting of drug use (in-/outpatient 
use); type of use (short/long-term, as needed); and different 
indications of use. All drug-AE pairs needed to fulfil these 
criteria. Furthermore, at least one drug-AE pair was selected 
taking into account those chosen by the public-private US 
initiative Observational Medical Outcomes Partnership 
(OMOP) in order to facilitate comparison with this initiative 
[27]. 

An initial inventory of potential drug-AE pairs was 
compiled, based on recommendations from public and 
private partner experts in the field of epidemiology and 



132 Current Clinical Pharmacology, 2014, Vol. 9, No. 2 

pharmacovigilance (European and national medicines 
agencies, pharmaceutical industry and academia). All 
partners were asked to nominate 10 drug-AE pairs that 
would fulfil the previously defined criteria for selection. This 
resulted in an initial list of 55 AEs and >55 individual drugs 
and drug classes. A first consensus meeting produced five 
AEs and a limited number (<3) of drugs per AE with high 
priority. Supported by extensive research of the scientific 
literature and publicly available information sources, 
including PubMed, EMA and the US Food and Drug 
Administration (FDA) websites, each of the criteria for the 
selected drug-AE pairs was assessed. Subsequent to this 
assessment, the selection of five drug-AE pairs was finalized 
in a second consensus meeting. 

Databases 

All PROTECT partners who manage or have access to 
electronic healthcare or reimbursement databases were asked 
to describe characteristics of these databases. Databases 
incorporated medical and registry-based data sources, such 
as the Danish national registries, the Dutch Mondriaan 
project, the British CPRD and The Health Improvement 
Network (THIN) databases, the Spanish BIFAP project and 
the German Bavarian claims database. In addition, the 
French PGRx case-referent system will be made available to 
investigate and/or confirm some of the drug-AE pairs. All 
partners were sent a questionnaire in order to systematically 
collect the information. Parameters included information on 
period of data collection, coding systems, accessibility 
procedures and an extensive list of specific categories for 
longitudinally collected data such as drug prescribing/ 
dispensing, clinical data, laboratory test data and life style 
parameters. The databases from the Netherlands, Spain, 
Denmark, and UK are based on primary care (GP and/or 
Pharmacy) covering all prescription drugs regardless of 
reimbursement. 

Analytical Approach 

Common study protocols to study each of the drug-AE 
pairs have been developed and comply with the ENCePP 
methodological standards (including the ENCePP checklist) 
and were submitted to the ENCePP registry of studies [28] . 
These protocols include different study designs such as 
cohort, case-control, and case-cross-over design. All studies 
are retrospective, based on existing data from the databases 
described above. We will use data from the period 2001- 
2009. Inclusion for entry in the cohort studies is that subjects 
would have to have at least 1 recorded prescription or 
dispensing of the drug of interest. This approach reduced 
confounding by indication and still allows comparing 
between subjects that are on the drug at a certain time during 
follow-up versus subjects that are not currently on the drug 
but used the drug in the past. Operational definitions of 
exposures and outcomes are harmonized as much as possible 
and varied in a range that reflects the possibilities and 
limitations of the available databases. For the outcome of 
liver injury a automated algorithm has been developed taking 
into account diagnostic codes and laboratory tests. Detailed 
code lists are available upon request. Exposure will be 
analysed time-dependently in all studies and some 
confounders will also be classified time-dependently if 
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appropriate. Different methods for the selection of and 
control for confounding variables will be applied. Not all 
databases have the same level of detail with regard to 
confounders. We will conduct an analysis for each drug-ae 
pair that includes a minimum set of confounders that all 
databases have available. In subsequent sensitivity analyses 
we will also assess the impact of further adjustment for 
confounders that are available in some, but not all databases. 
For all databases we will describe exposure to the drugs of 
interest and for those databases with sufficient information 
on diagnoses we will describe the outcomes of interest. For 
the association studies we have implemented a blinding 
procedure with central results management. Results for each 
design will be un-blinded only after all databases have been 
analysed and produce the adjusted association measures. 

RESULTS 

The Drug-AE Pairs 

The five drug-AE pairs fulfilling the a priori defined 
criteria are: 1) inhaled long-acting beta-2 agonists and acute 
myocardial infarction; 2) antimicrobials and acute liver 
injury; 3) antidepressants and/or benzodiazepines and hip 
fracture; 4) anticonvulsants (approved for treatment of 
epilepsy) and suicide/suicide attempts; 5) calcium channel 
blockers and malignancies. The following information is 
described for each drug-AE pair: public health impact, drug 
utilisation, the level of evidence to support a causal 
association, the proposed pharmacological mechanism(s), 
and methodological challenges specific for the drug-AE 
association. Table 1 shows the selected AEs and their 
characteristics. Table 2 shows the characteristics of the 
selected drugs. Table 3 displays the drug-AE associations 
and characteristics such as the range of relative risks, the 
study designs that have been used to study the association, 
the main methodological issues, and the suggested hazard 
function (in relation to onset and offset of the increased risk 
after initiation or discontinuation of the drug). 

The Databases 

General features of the databases participating in 
PROTECT are presented in Table 4. The six databases 
contain data from patients from five different European 
nations: the Danish national registries, the Dutch Mondriaan 
database, the British CPRD and THIN databases, the Spanish 
BIFAP project, the German Bavarian claims database. The 
Danish registries have national coverage, while other databases 
contain regional data or a representative sample of a total 
population. All the databases were quite representative of 
their nation. Most of the databases were established more 
than 10 years ago with regular and expanding data collection 
and validation history. Routine checks on quality are 
performed in all databases. The majority of databases include 
GP data and two (Danish and CPRD) include registries for 
and linkages to mortality, cancer, and secondary care data. 
Three (Danish registries, Mondriaan and Bavarian claims) 
out of six databases include or had linkages to claims data. A 
particular characteristic of the Bavarian Claims database is 
the availability of information on prescriptions and 
diagnoses in quarters of a calendar year. The exact dates of 
prescribing and diagnoses are not available. Therefore, we 
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AE 


Non-Fatal /Fatal Incidence 


Regulatory 
Triggers/Action 


Seriousness 


Ascertainment 


Feasibility of 
Ascertainment in EHR 


Acute 
myocardial 
infarction 


Non- 
fatal 
Fatal 


ouj/ ruu,uuu nospitai 
discharges due to CHD in 
2009 [33] 
76 {range: 30-313}/ 
100,000 in 2010 [34] 


Drug withdrawal/ 
Boxed warning [30] 


10% disability- 
adjusted life years lost 

by CHD in 2010 [33] 
28-day case fatality of 

IHD: 34%-88% [35] 


Clinical, 
laboratory and 
ECG criteria 


Moderately Easy 


Idiopathic 
acute liver 
injury 


Non- 
fatal 

iatai 
Fatal 


1-41/100,000 person years 
po-joj 
10% of all AE [39] 
0.8/million person-years 
[36] 


Drug withdrawal/ 
Boxed warning 
[30,40,41] 


6 months case fatality: 

12% [36] 
29% of patients acute 
jaundice [42] 


Diverse 
clinical, 
laboratory and 
histological 
data [43] 


Moderately Difficult 


Hip fracture 


Non- 
fatal 
Fatal 


ou-zuu /ruu,uuu/yr [44 j 
20-24% fatality rate 
within 1 yr [45,46] 


Warning in product 

information of 
antiretrovirals [47] 
& 

thiazolidinediones 
[48, 49] 


3.3 years: mean 
interval between 
fractures [50] 


Hospital 
admission 


Easy 


Suicide/suicide 
attempt 


Non- 
fatal 
Fatal 


50-100/100,000/yr 

attempts [5 1 ] 
10/100,000/yr [52] 


Drug 
withdrawal/Boxed 
warning [30] 




Cause of death 

Hospital 
admission due 
to self-harm 


Difficult 


Cancer 


Non- 
fatal 
Fatal 


414-600/100,000 new 
cases/yr [53] 
170/100,000/yr [34] 


For biologicals [41] 


5-year fatality rate: 
43%-71% [53] 


Tumour 
diagnosis 
cancer registry 


Moderately Easy 



AE = adverse event 

IHD = ischemic heart diseases or CHD= coronary heart diseases both terms include acute myocardial infarction 

EHR = electronic healthcare records 

1 ] = number indicating the reference including these data 



Table 2. Selected medications and their characteristics. 



Drug 


Range Prevalence of Drug Exposure per Thousand Inhabitants 


Most Frequent Type of Use 


Short / long acting beta-agonists 


66 [54] to 84 [55] /l 000 


As needed/chronic 


Antimicrobials 


236 [56] to 344 [54] /1000 


Short term/long term use 


Antidepressants/benzodiazepines 

SSRI 
TCA 
Benzodiazepines 


30 [56] to 55 [54] /l 000 
15 [56] toll [54]/1000 
30 [56] to 81 [54] /l 000 


As needed/long term use 


Anticonvulsants 


17 [56] to 22 [55]/1000 


Chronic 


Calcium channel blockers 


45 [55] to 70 [54]/1000 


Chronic 



SSRI = selective serotonin reuptake inhibitor 
TCA = tricyclic antidepressants 

[ ] = number indicating the reference including these data 



decided to use this database for descriptive purposes only 
and refrained from conducting association studies for which 
this information is pivotal. For some databases, linkage 
to other national registries requires additional procedures 
and financial compensation. Table 4 briefly describes the 
participating databases. 



DISCUSSION AND UPCOMING STUDIES IN 
PROTECT 

We prioritised five drug-AE associations that are highly 
relevant from the perspective of various stakeholders including 
regulatory agencies, patients and the pharmaceutical 
industry. These associations allow investigation of the 
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Relative Risk [(RR) 


Source 
(Type of Study) 


Main Methodological 
Issues 


Hazard 
Function 


SABA/LABA 
and AMI 


RR > 2 for cardiovascular events vs. placebo [57] 
ORs 1.7 - 7.3 (new users) for MI vs. non-users [57] 


Systematic review 
(RCT) 
(Case-control) 


Protopathic bias 
Confounding by 
indication /severity 


Acute onset, 
transient 


RR = 2.5 for respiratory deaths vs. placebo [58] 


Meta-analysis 
(RCT) 


salmeterol: all cause mortality Peto OR =1.3 vs. placebo [59] 

non-fatal AE OR = 1.2 vs. placebo [59] 
formoterol : non-fatal serious AE OR =1.6 vs. placebo [60] 


Cochrane database 
systematic review 
(RCT) 


OR 1.2 for beta-2 agonists (current users) - 2.5 (IHD patients) [61] 
RR =1.6 for SABA (heavy users vs. users of <3 months) [62] 
RR =1.1 for LAB A (heavy users vs. users of <3 months) [62] 


Nested case- 
control cohort 


Antimicrobials 
and ALI 


Elevated liver enzymes, cholestasis, and acute liver failure 
(for betalactam antimicrobials, macrolides, sufonamides, 
tetracyclines [63] 


Case reports/ 
retrospective 
cohort 


Definition/measureme 

nt of the outcome 
Ascertaining/tracing 
of exposure (short 
time window) 


Acute/interme 
diate onset 
(3-4 weeks) 
after drug 
stop 


RRs 2.3 (Amoxicillin without clavulanic acid) - 1299.9 
(Isoniazid + rifampicin + pyrazinamide) [64] 


Case-population 


ORs 5.3 (erythromycin) - 94.8 (amoxicillin/clavulanic acid) [37] 


Case-control 
(pop-based) 


Antidepressants/ 
BZD and hip 
fracture 


RRs 1.2 - 3.7 for TCA users [65] 
RRs 1.5 - 8.6 for SSRI users [65] 
RRs 1.5 - 2.0 for hypnotics including BZD [66] 


Case-control/ 
cohort 


Exposure 
classification (for 
antidepressants) 
Selection bias 
Unmeasured 
confounding 


SSRIs: peak 

at 6-12 
months [67] 
TCA's: peak 
at 1-2 months 

[67] 
BZD: acute 


Anticonvulsants 
and suicide/- 
attempts 


RR = 2 for 1 1 different groups of the drag (1.5 (psychiatric) 3.5 
(epilepsy) risk by indication) [68] 


Meta-analysis of 
RCT 


Definition and 
measurement of 
outcome 


Acute 


RR = 3.1 for current users (lamotrigine, gabapentin, ethosuximide, 
vigabatrin) [69] 
OR 2.57 vs. non-users [70] 


Nested case- 
control 


HRs 1.4 - 2.4 vs. topiramate users [71] 


Cohort 


CCB and cancer 


RRs 1.7 (vs. non-users) - 2.6 (breast cancer) [72, 73] 
RR = 2.1 for verapamil [74] 


Cohort 


Long latent period 
Selection bias 
Unmeasured 
confounding 


Long-term, 
delayed 



SABA = short acting beta-2 agonists BZD = benzodiazepines AE = adverse event 

LABA = long acting beta-2 agonists SSRI = selective serotonin reuptake inhibitor TCA = tricyclic antidepressants 

(A)MI = (acute) myocardial infarction RR = relative risk; OR =odds ratio, HR= hazard ratio [Number] = number of reference including these data 

ALI = acute liver injury IHD = Ischemic Heart Diseases CCB = calcium channel blockers 



influence of variation in methodology. Furthermore, we 
characterised seven routine electronic healthcare databases 
from five European countries that will be used for the 
evaluation of the selected drug-AE associations. 

The work of WP2 of PROTECT is in the front line of 
currently on-going large (inter-) national initiatives such as 
the Observational Medical Outcomes Partnership (OMOP), 
FDA Sentinel Initiative [29] and EU-ADR (EU-Adverse 
Drug Reactions) project [30]. OMOP is a public-private 
partnership that conducts experiments to assess value, 



feasibility, and utility of observational data to identify and 
evaluate the safety risks and potential benefits of prescription 
drugs [31]. Furthermore, OMOP tests approaches for 
creating the infrastructure for accessing and managing the 
required data. The FDA Sentinel initiative aims at 
development of a national electronic safety monitoring 
system in order to strengthen FDA's ability to monitor post- 
marketing performance of medical products and to enable 
FDA to access existing automated healthcare data by 
partnering with data holders. EU-ADR project is focussing 
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Database / Country 


Danish 
Registries 
(DK) 


Mondriaan 
(NL) 


GPRD 

(UK) 


THIN 

(UK) 


BIFAP 

(ES) 


Bavarian 
Claims 
(DE) 


Nr. of persons with historical data (in 
Millions) 


approx. 6 


1.4 (GP) 
13.5 (pharmacy) 
1.2 (claims) 


11.2 


11 


3.2 


10.5 


Nr. of active persons in 2008 (in millions) 


5.2 


0.6 


4.6 


3.8 


1.6 


9.5 


Starting year of data collection 


1994 a 
1977 b 


1991 


1987 


2003 


2001 


2001 


Nationwide 


+ 


90%ofNL 
(pharmacy) 


7% of the UK 


6.2% of the UK 


7% of Spain 




Representative of nation 


+ 


+ 


+ 


+ 


+e 


+c 


Type of database 














General practitioner 


+ 


+ 


+ 


+ 


+ 


+h 


Pharmacy 


+ 


+ 


/f 




/f 


+h 


Mortality registry 


+ 


/ linkage 


+ g 




/ 




Cancer registry 


+ 




+ linkage 








Hospitalisation registry 


+ 


/linkage 


+ linkage 




/ 




Specialist/secondary care 


+ 


/ 


+ linkage 






+ 


Claims 


+ 


+ 








+ 


National statistics 


+ 




/ 








Surveys 




+ 










Routine data quality checks 


+ 


+ 


+ 


+ 


+ 


+ 


Possibility of prospective data collection 
among patients in the database d 




/ 


+ 


+ 


+ 





DK = Denmark, NL = The Netherlands, UK = United Kingdom, ES = Spain, DE = Germany 

+ = data is available 

/ = data is partly available 

a = Medicinal products 

b = Patient registration 

c = representative of the region 

d = For Interviews, trials, surveys 

e = GPs from 9 out of 17 regions in Spain. 15% of the collaborating regions and 7% of the total population. Representative of population attending primary care in Spain (similar 
age and sex distribution) 
f = prescribed not dispensed 

g = contains records of death but is not the official registry 
h = prescriptions and diagnoses are only available per quarter (no exact dates) 

on utilizing electronic healthcare data records and 
biomedical databases for the early detection of AEs. In the 
EU-ADR project a list of 23 events were judged as important 
in pharmacovigilance and three AE (acute myocardial 
infarction, acute liver injury, and suicidal behaviour/attempt) 
on this list have also been prioritised in our project. The 
OMOP project has also defined a list of health outcomes of 
interest (HOI) and drug pairs to be further investigated. As 
previously mentioned we included two of these pairs (DILI 
and antimicrobials, hip fracture and benzodiazepines) in our 
prioritised list of five drug-AE pairs. Although these projects 
have a different focus than those of WP2 of PROTECT, the 
overlap in prioritised AEs (and drugs) will facilitate 
comparisons. 



The strengths of our approach include the development 
of a common study protocol (that includes variation in 
methodology e.g. different designs) for five drug-AE 
associations that will be studied in different databases. In 
addition, some of our findings will be confirmed in specific 
registries such as PGRx [32]. Our approach will allow us to 
distinguish between variation in results due to variation in 
methodology and those due to database differences. 
Analysing these discrepancies will provide guidance 
regarding the optimal methodology for certain safety issues 
and the optimal selection of appropriate data source(s). The 
experience obtained in the PROTECT database network will 
improve the possibilities for multinational database studies 
for various safety issues, including the investigation of rare 
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serious AE. Finally, other research activities of WP2 of 
PROTECT will further improve the methodological 
guidance on pharmacoepidemiological studies. These 
include an evaluation and improvement of methods to 
control for confounding such as propensity scores and 
instrumental variables in simulation studies, and drug 
utilisation research. 

A limitation of our approach may be the scope of the 
drug-AE pairs and selected healthcare databases. Our 
findings may not be extendable to other safety issues or other 
databases that we do not study. However, our selection of 
drug-AE pairs includes common drug safety issues 
presenting different methodological challenges. The different 
types of databases (GP, claims, and registries) owned by 
PROTECT partners, also make extrapolation of our findings 
to wider ranges of data sources possible. Furthermore, our 
findings will be validated by testing different drug-AE pairs 
in the same databases and confirmation of drug-AE 
association in specific registries that include more detailed 
information on outcomes and potential confounding factors. 

In conclusion, WP2 of PROTECT will assess the 
influence of methodological parameters on the association 
between selected AEs and drug class of interest. The selected 
AEs include resulted in (major) regulatory decisions such as 
drug withdrawal or SmPC changes or allow the investigation 
of a broad range of relevant methodological issues. The 
anticipated results of this project include the creation of a 
European database network and further development of 
methodological standards for the conduct of (multi-) national 
PE studies. Methodological standards will be included when 
appropriate in the EMA-based ENCePP guidance on 
methodological standards. Increasing methodological 
standards and registration of study protocols may decrease 
discrepancies in results from these studies, increase 
transparancy and thereby increase the usefulness and 
reliability of these studies for benefit-risk assessment and 
decision- making of marketed drugs in Europe and beyond. 
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